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Abstract 

We consider a model of heat conduction introduced in 0, which 
consists of a finite nonlinear chain coupled to two heat reservoirs at 
different temperatures. We study the low temperature asymptotic be- 
havior of the invariant measure. We show that, in this limit, the in- 
variant measure is characterized by a variational principle. We relate 
the heat flow to the variational principle. The main technical ingredi- 
ent is an extension of Freidlin-Wentzell theory to a class of degenerate 
diffusions. 



1 Introduction 

We consider a model of heat conduction introduced in ||. In this model 
a finite non-linear chain of n c?-dimensional oscillators is coupled to two 
Hamiltonian heat reservoirs initially at different temperatures Tl,Tr, and 
each of which is is described by a d-dimensional wave equation. A natural 
goal is to obtain a usable expression for the invariant (marginal) state of the 
chain analogous to the Boltzmann-Gibbs prescription fj, = Z~ x exp (-H/T) 
which one has in equilibrium statistical mechanics. What we show here 
is that the invariant state [i describing steady state energy flow through 
the chain is asymptotic to the expression exp (— W'*"/T) to leading order 
in the mean temperature T, T —* 0, where the action W^ v \ defined on 
phase space, is obtained from an explicit variational principle. The action 
W^ 1 ' depends on the temperatures only through the parameter r\ = (Tl — 
Tr)(Tl + Tr). As one might anticipate, in the limit i] — > 0, reduces 
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to the chain Hamiltonian plus a residual term from the bath interaction, 
i.e., exp (— P')/T) becomes the Boltzmann-Gibbs expression. We remark 
that the variational principle for here certainly has analogues in more 
complicated arrays of oscillators, plates with multiple thermo-coupled baths, 
etc. The validity of this variational principle in more complex systems, as 
well as the physical phenomena to be deduced from are questions which 
remain to be explored. 

Turning to the physical model at hand, we assume that the Hamiltonian 
H(p, q) of the isolated chain is assumed to be of the form 

n 2 n n—1 

h(p,i) = Ef + E^ (1 WE c/(2) («+i), 

i=l i=l i=l 

n 2 

= Ey + ^), (i) 
i=l z 

where qi and pi are the coordinate and momentum of the i-th particle, and 
where tA 1 ) and are C°° confining potentials, i.e. lim^ q ^ oc V(q) = +oo. 

The coupling between the reservoirs and the chain is assumed to be of 
dipole approximation type and it occurs at the boundary only: the first 
particle of the chain is coupled to one reservoir and the n-th particle to 
the other heat reservoir. At time t = each reservoir is assumed to be 
in thermal equilibrium, i.e., the initial conditions of the reservoirs are dis- 
tributed according to (Gaussian) Gibbs measure with temperature T\ = Tl 
and T n = Tr respectively. Projecting the dynamics onto the phase space of 
the chain results in a set of integro-differential equations which differ from 
the Hamiltonian equations of motion by additional force terms in the equa- 
tions for pi and p n . Each of these terms consists of a deterministic integral 
part independent of temperature and a Gaussian random part with covari- 
ance proportional to the temperature. Due to the integral (memory) terms, 
the study of the long-time limit is a difficult mathematical problem (see [[[J] 
for the study of such systems in the case of a single reservoir). But by a 
further appropriate choice of couplings, the integral parts can be treated as 
auxiliary variables r% and r n , the random parts become Markovian. Thus 
we obtain (see || for details) the following system of Markovian stochastic 
differential equations on the extended phase space Y{ 2dn+2d : For x = (p, q, r) 

0.1 = Pi: 

Pi = -V qi V(q)+n, 

Qj = Pj . 
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is = -^<ij v (q) > 3 = 2, • • • , n - 1 , 

Qn — Pn j 

= -^q n V{q) +r n , 

dn = -'Jin - X 2 q 1 )dt + {2jX 2 T 1 ) 1 / 2 dw 1 , 

dr n = - 1 {r n -\ 2 q 1 )dt+{2 1 \ 2 T n ) 1 l 2 dw n , (2) 

In Eq. (@), u>i(t) and u; n (i) are independent d-dimensional Wiener processes, 
and A 2 and 7 are constants describing the couplings. 

It will be useful to introduce a generalized Hamiltonian G(p, q, r) on the 
extended phase space, given by 

G(p,q,r)= ]T [d-- n qi]+H( P ,q) : (3) 



i=l, n 



where H (p, q) is the Hamiltonian of the isolated systems of oscillators given 
by (|H). We also introduce the parameters e (the mean temperature of the 
reservoirs) and r\ (the relative temperature difference): 

= Ti + r n = T x -T n 
E 2 ' 11 Tt + T n ' U 

Then Eq. (|2|) takes the form 

q = V P G, 

P = -VqG, 

dr = - 1 \ 2 y r Gdt + e l/2 {2 1 \ 2 D) l l 2 dw, (5) 

where p = (pi, . . . , Pn ), q = (qi, . . . ,q n ), r = (n,r n ) and where D is the 
2d x 2d matrix given by 

The function G is a Liapunov function, non-increasing in time, for the de- 
terministic part of the flow (||). If the system is in equilibrium, i.e, if 
T\ = T n = e and rj = 0, it is not difficult to check that the generalized 
Gibbs measure 

f i £ = Z- 1 exp(-G(p,q,r)/e), (7) 
is an invariant measure for the Markov process solving Eq. (J5h. 
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If the temperature of the reservoirs are not identical, no explicit formula 
for the invariant measure HT\,T n can be given, in general. It is the goal of 
this paper to provide a variational principle for the leading asymptotic form 
for fJ,T 1; T n , at low temperature, e — > 0. To suggest what HTi,T n looks like, we 
observe that a typical configuration of a reservoir has infinite energy, there- 
fore the reservoir does not only acts as a sink of energy but true fluctuations 
can take place. The physical picture is as follows: the system spends most 
of the time very close to the critical set of G (in fact close to a stable equilib- 
rium) and very rarely (typically after an exponential time) an excursion far 
away from the equilibria occurs. This picture brings us into the framework 
of rare events, hence into the theory of large deviations and more specifically 
the Freidlin-Wentzell theory ||] of small random perturbations of dynamical 
systems. 

In the following we employ notation which is essentially that of pi. Let 
C([0,T]) denote the Banach space of continuous functions (paths) with val- 
ues in R, 2d ( n + 1 ) equipped with the uniform topology. We introduce the fol- 
lowing functional ij^j, on the set of paths C([0, T]): If <j){t) = (p(t), q(t),r(t)) 
has one L 2 -derivative with respect to time and satisfies (p(0) = x we set 

^tWO = j\r + lX 2 VrG)D-\r + 1 \ 2 V r G)dt, (8) 

if 

q{t) = V p G(0(i)) , p{t) = -V q G&(t)) , (9) 

and I^ T (<p) = +oo otherwise. Notice that I^(4>) = if and only if cf>(t) is a 

solution of Eq. (||) with the temperature e set equal to zero. The functional 

(v) 

Ij, Jp is called a rate function and it describe, in the sense of large deviation, 
the probability of the path (j>: roughly speaking, as e — > 0, the asymptotic 
probability of the path eft is given by 

exp (-ll%W/e) . (10) 

For x,y G R 2d ( Tl + 1 ) we define V^(x,y) as 

V^(x,y)=mt : inf 1^(0), (11) 

1 >0 <t>:<t>(T)=y 

and for any sets B, C G R 2d ( n+1 ) we set 



V^(B,C)= inf V^(x,y). (12) 
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The function V™(x, y) represents, roughly speaking, the cost to bring the 
system from x to y (in an arbitrary amount of time) . We introduce an equiv- 
alence relation on the phase space 

R 2d(n+1). 

we say x ~ y if vW(x,y) = 
V^(y, x) = 0. We divide the critical set K = {x ; VG(x) = 0} (about which 
the invariant measure concentrates) according to this equivalence relation: 
we have K = Uj-Kj with x ~ y if x E K},y € i£i and x ^ y if x E K{,y G Kj, 
i + 3- 

Our first assumption is on the existence of an invariant measure, the 
structure of the set K and the dynamics near temperature zero. Let p > 
be arbitrary and denote B(p) the p- neighborhood of K and let t p be the 
first time the Markov process x(t) which solves (JsJ) hits B(p). 

• Kl The process x(t) has an invariant measure. The critical set A of 
the generalized Hamiltonian G can be decomposed into a finite number 
of inequivalent compact sets iQ. Finally, for any eo > 0, the expected 
hitting time E x (t p ) of the diffusion with initial condition x is bounded 
uniformly for < e < Eq. 

Remark 1.1 The assumption Kl ensures that the dynamics is sufficiently 
confining in order to apply large deviations techniques to study the invariant 
measure. 

Remark 1.2 The assumptions used in ||, ||] to prove the existence of an 
invariant measure imply the assumption made on the structure of the criti- 
cal set A. But it is not clear that they imply the assumptions made on the 
hitting time. We will merely assume the validity of condition Kl in this 
paper. Its validity can be established by constructing Liapunov-like func- 
tions for the model. Such methods allow as well to prove a fairly general 
theorem on the existence of invariant measures for Hamiltonian coupled to 
heat reservoirs (under more general conditions that in || ||) and will be the 
subject of a separate publication 

Our second condition is identical to condition H2 of || [|. 

• K2 The 2-body potential C/ (2) (q) is strictly convex. 

Remark 1.3 The condition K2 will be important to establish various reg- 
ularity properties of V^(x, y). It will allow to imply several controllability 
properties of the control system associated with the stochastic differential 
equations (||). 



5 



Following (8[, we consider graphs on the set {1, . . . , L}. A graph con- 
sisting of arrows m — > n, (m € {1, . . . ,L} \ {i}, m £ {1, . . . , L}), is called a 
{z}-graph if 

1. Every point j, j ^ i is the initial point of exactly one arrow. 

2. There are no closed cycles in the graph. 

We denote G{i} the set of {i}-graphs. The weight of the set K{ is defined 
by 

W<n\Ki)= min ]T vW(K m ,K n ). (13) 

9 fc U SI m ^ n £g 

Our main result is the following: 

Theorem 1.4 Under the conditions Kl and K2 £/ie invariant measure 
MTx T„ = Me,t7 °/ ^ e Markov process ^) has the following asymptotic be- 
havior: For any open set D with compact closure and sufficiently regular 
boundary 

lime log ^ e -(D) = inf (s) , (14) 

e^O ' xED 

where 

, x)j — min W^iKj). (15) 

In particular, if r\ = 0, then 

W&\x) = G{x) — min G{x) . (16) 

The function W^' (x) satisfies the bound, for r/ > 0, 
(1 + n) -1 \G(x) — min 

(17) 

and a similar bound for n < 0. 



Remark 1.5 Eqs. (|16| ) an d (|l?| ) imply that /i e „ reduces to the Boltzmann- 
Gibbs expression [i e ~ exp (— G/e) for n — > in the low temperature limit. 
Of course, at n = 0, they are actually equal at all temperatures e. More- 
over these equations imply that the relative probability fj, £ ^ v (x)/ fi £ ^(y) is 
(asymptotically) bounded above and below by 



exp 



G(x) G(y) 



_e(l±n) e(lTy). 
so that no especially hot or cold spots develop for 



(18) 
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Remark 1.6 The theorem draws heavily from the large deviations theory 
of Freidlin-Wentzell ||. But the theory was developed for stochastic differ- 
ential equations with a non-degenerate (elliptic) generator, but for Eq. (0) 
this is not the case since the random force acts only on 2d of the 2d(n + 1) 
variables. A large part of this paper is devoted to simply extending Freidlin- 
Wentzell theory to a class of Markov processes containing our model. De- 
generate diffusions have been considered in ||] but under too stringent con- 
ditions and also in [g] but with conditions quite different from ours. We 
also note that the use of Freidlin-Wentzell theory in non-equilibrium statis- 
tical mechanics has been advocated in particular by Graham (see [ 10 1 and 



references therein). In these applications to non-equilibrium statistical me- 
chanics, as in [|l(]], the models are mostly taken as mesoscopic: the variables 
of the system describe some suitably coarse-grained quantities, which fluc- 
tuate slightly around their average values. In contrast to these models, ours 
is entirely microscopic and derived from first principles and the small-noise 
limit is seen as a low-temperature limit. 

Finally we relate the large deviation functional to a kind of entropy 
production. As in @ we define this entropy production £ by 

E = -£-|?, (19) 



where 



Fi(p,q,r) = pi(ri - X qi) = X p x V ri G(p, q, r) , 

F n (p,q,r) = p n (r n - X 2 q n ) = X 2 p„V rn G(p,q,r) , (20) 

are the energy flows from the chain to the respective reservoirs. In |j] it 
is shown that /XTi,T n (S) > and /iTi,T n (S) = if and only if T\ = T n . 
This implies that, in the stationary state, energy is flowing from the hotter 
reservoir bath to the colder one. With the parameters e and r] as defined in 
(H) we define by 

i e = e = - (— ^ . (2i) 

£ e V 1 + 7} 1 -TjJ 

In order to show the relation between the rate function I x ^ and the entropy 
production S, we introduce the time-reversal J, which is the involution on 
the phase space 

R 2d(n+1) 

given by J(p,q,r) = (—p,q,r). The following 
shows that the value of the rate function of a path 4> between x and y and 
is equal (up to a boundary term) to the value of the rate function of the the 
time reversed path <p between Jy and Jx minus the entropy produced along 
this path. 
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Proposition 1.7 Let <j>(t) G C([0,T]) with 0(0) = x and <j>(T) = y. Either 



r (v) 

L x,T 



((f)) = +00 or we have 



r 



if 77 = , 

8(0(s))cfe, if 77 ^0, (22) 



where O is defined in Eq. (21 ) and R(x) = (1 + n) 1 (X 1 r\ — Xqi) 2 + (1 — 
^(A-Vn-Afe) 2 . 



The identities given in Proposition 1.7 are an asymptotic version of identities 
which appear in various forms in the literature. These identities are the basic 
ingredient needed for the proof of the Gallavotti-Cohen fluctuation theorem 
A, H for stochastic dynamics [17, 15, 2C] and appear as well in the Jarsynski 



non-equilibrium work relation]]^ 

The paper is organized as follows: In Section Q we recall the large de- 
viation principle for the paths of Markovian stochastic differential equation 
and using methods from control theory we prove the required regularities 
properties of the function (x, y) defined in Eq. (0). Section || is devoted 
to an extension of Freidlin-Wentzell results to a certain class of diffusions 
with hypoelliptic generators (Theorem |3.3| ): we give a set of conditions un- 
der which the asymptotic behavior of the invariant measure is proved. The 
result of Section |2| implies that our model, under Assumptions Kl and K2, 
satisfies the conditions of Theorem |3.3| . In Section || we prove the equality 
( |l6| ) and the bound ( |17| ) which depend on the particular properties of our 
model. 



2 Large deviations and Control Theory 

In this section we first recall a certain numbers of concepts and theorems 
which will be central in our analysis: The large deviation principle for the 
sample path of diffusions introduced by Schilder for the Brownian motion 
[p2| and generalized to arbitrary diffusion by ||, |], |H] (see also || ) , and the 
relationship between diffusion processes and control theory, exemplified by 
the Support Theorem of Stroock and Varadhan [p4| . With these tools we 
then prove several properties of the dynamics for our model. We prove that 
"at zero temperature" the (deterministic) dynamics given by is dissipative: 
the w-limit set is the set of the critical point of G(p,q,r). We also prove 
several properties of the control system associated to Eq. (|5|): a local con- 
trol property around the critical points of G(p, q, r) and roughly speaking 
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a global "smoothness" property of the weight of the paths between x and 
y, when x and y vary. The central hypothesis in this analysis is condition 
K2: this condition implies the hypoellipticity, [O], of the generator of the 
Markov semigroup associated to Eq. (|5|), but it implies in fact a kind of 
global hypoellipticity which will be used here to prove the aforementioned 
properties of the dynamics. 



2.1 Sample Paths Large Deviation and Control Theory 

Let us consider the stochastic differential equation 

dx(t) = Y(x)dt + e 1/2 a(x)dw(t) , (23) 

where x £ X = R n , Y(x) is a C°° vector field, w(t) is an m-dimensional 
Wiener process and o~(x) is a C°° map from R m to R n . Let C([0, T]) de- 
note the Banach space of continuous functions with values in R n equipped 
with the uniform topology. Let L 2 ([0, T]) denote the set of square integrable 
functions with values in R m and H\([0,T]) denote the space of absolutely 
continuous functions with values in R m with square integrable derivatives. 
Let x £ (t) denote the solution of (|23| ) with initial condition x e (0) = x. We 
assume that Y(x) and cr(x) are such that, for arbitrary T, the paths of the 
diffusion process x e (t) belong to C([0, T]). We let P% denote the probabil- 
ity measure on C([0, T]) induced by x £ (t), < t < T and denote E e x the 
corresponding expectation. 

We introduce the rate function I x ,T{f) on C([0,T]) given by 

4,t(/)= t inf \ [ T \g(t)\ 2 dt, (24) 

{gGH 1 :f(t)=x+J Q Y(f(s))ds+J a(f(s))g(s)ds} 1 J 

where, by definition, the infimum over an empty set is taken as +00. The 
rate function has a particularly convenient form for us since it accommodates 
degenerate situations where ranker < n. 

In Q, Corollary 5.6.15 (see also the following large deviation princi- 
ple for the sample paths of the solution of ( p3|) is proven. It gives a version 
of the large deviation principle which is uniform in the initial condition of 
the diffusion. 



Theorem 2.1 Let x e {t) denote the solution of Eq. (25) with initial con- 
dition x. Then, for any x £ R n and for any T < 00, the rate function 
Ix,T(f) is a lower semicontinuous function on C([0, T]) with compact level 
sets (i.e. {/ ; I x ,T(f) < a } is compact for any a G H). Furthermore the 
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family of measures satisfy the large deviation principle on C([0, T]) with 
rate function I x ,T(f) : 

1. For any compact K C X and any closed F C C([0,T]), 

lim sup log sup P x (x £ G F) < — inf inf I x T{<f)- (25) 

£^0 x&K x&K<P£F 

2. For any compact K C X and any open G C C([0, T}), 

lim inf log inf P x (x £ £(?)>- sup inf I x x{(t>)- (26) 

Recall that for our model given by Eq. (||), the rate function takes the 
form given in Eqs. @ and (g). We introduce further the cost function 
V T {x,y) given by 

V T (x,y) = inf I xT (<P)- (27) 

Heuristically Vr(x,y) describes the cost of forcing the system to be at y 
at time T starting from x at time 0. The function V(x,y) defined in the 
introduction, Eq. (|ll|) is equal to 

V(x,y) = mf V T (x,y), (28) 

and describes the minimal cost of forcing the system from x to y in an 
arbitrary amount of time. 

The form of the rate function suggest a connection between large devi- 
ations and control theory. In Eq. (^J|), the infimum is taken over functions 
g € Hi([0,T]) which are more regular than a path of the Wiener process. 
If we do the corresponding substitution in Eq. (]23|), we obtain an ordinary 
differential equation 

x(t) = Y(x(t))+a(x(t))u(t), (29) 

where we have set u(t) = e 1/2 5(t) G L 2 ([0,T}). The map u is called a control 
and the equation ( p9[ ) a control system. We fix an arbitrary time T > 0. 
We denote by : [0, T] — ► R n the solution of the differential equations 
( p9| ) with control u and initial condition x. The correspondence between 
the stochastic system Eq. ( p3|) and the deterministic system Eq. (f29|) is 
exemplified by the Support Theorem of Stroock and Varadhan p3. The 
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support of the diffusion process x(t) with initial condition x on [0, T], is, by 
definition, the smallest closed subset S x of C([0, T]) such that 

P x [x(t)eS x ] = l . (30) 

The Support Theorem asserts that the support of the diffusion is equal to 
the set of solutions of Eq. ( |29|) as the control u is varied: 

S x = {<p% : «£l 2 ([0,T]) } , (31) 

for all x € R fc . The control system ( p9| ) is said to be strongly completely 
controllable, if for any T > 0, and any pair of points x, y, there exist a 
control u such that y?"(0) = x and y?"(T) = x. In Jj it is shown that, under 
condition K2, the control system associated with the equation (9) is strongly 
completely controllable. This is an ergodic property and this implies, [fffl, 
uniqueness of the invariant measure (provided it exists). In terms of the 
cost function Vr(x, y) defined in (|27|), strong complete controllability simply 
means that Vr(x,y) < oo, for any T > and any x,y. The large deviation 
principle, Theorem |2.1| , gives more quantitative information on the actual 
weight of paths between x and y in time T, in particular that the weight 
is ~ exp(— ^Vt(x, y)). As we will see below, these weights will determine 
completely the leading (exponential) behavior of the invariant measure for 

X E (t), £ jO. 

2.2 Dissipative properties of the dynamics 

We first investigate the w-limit set of the dynamics "at temperature zero", 
i.e, when both temperatures Ti, T n are set equal to zero in the equations 
of motion. In this case the dynamics is deterministic and, as the following 
result shows, dissipative. 

Lemma 2.2 Assume condition K2. Consider the system of differential 
equations given by 

q% = V Pi G i = l,---,n, 

Pi = -V qi G i = l,...,n, (32) 
fi = — 7A 2 V ri G i = l,n. 

Then the uj -limit set of the flow given by Eq.^^j is the set of critical points 
of the generalized Hamiltonian G(p, q, r) = J2j=i, n (^~ 2r 'j r j1j) Jr ^ (p> Q.)> 
i.e., 

A = [x e R 2d ( n + 1 ) : VG(x) = 0} . (33) 
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Proof: As noted in the introduction G{x) is a Liapunov function for the flow 
given by (^). A simple computation shows that 



jG{x{t)) = - 7 A 2 £ (\-\(t) - qi {t)f 

i=l, n 



= - 7 A 2 £ |V n G(x(t))| 2 < 0. (34) 

i=X,n 

Therefore it is enough to show that the flow does not get "stuck" at some 
point of the hyper-surfaces (A~ 2 rj(t) — qi(t)) 2 = 0, i = 1, n which does not 
belong to the set A. 

Let us assume the contrary, i.e., that, for some trajectory and some times 
T\ < T 2 we have 

G(x(t)) = G(x(Tx)) for t G [T 1} T 2 ] . (35) 



We show that this implies that x(t) G A, for t G [Ti,T2]. From Eqs. (|3 
and p5| ) we have, for t G [Ti,T2], the identity 

\- 2 n(t) - qi (t) = V n G(x(t)) = 0. (36) 



Further, using Eq.(32), we obtain 

= ^(A- 2 n(i)-<zi(*)) = - 7 (X- 2 r 1 (t)-q 1 (t))- Pl (t) = - Pl (t). (37) 
Thus we get 

pi(t) = V Pl G(z(t)) = 0. (38) 

Since is a constant, 

= -pi(t) = V n G(s(t)) = V w y(g(t))-n(t), (39) 
and therefore 

V fi G(x(t)) = 0. (40) 
Using that A~ 2 ri(t) — Qi(t) = we can rewrite Eq. ( |39| ) as follows: 

= V 9l C/Wfe(t)) - X 2 gi (t) + V qi U^{ qi (t) - q 2 (t)) . (41) 

By the convexity condition on U^, K2, VU^ : K d R d is a diffeomor- 
phism with an inverse which we denote W. We can therefore solve Eq.(]4l|) 
in terms of q 2 and we obtain 

q 2 (t) = gi (t) - W (\ 2 qi (t) - V qi UW( qi (t))) = F( qi (t)) . (42) 
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From this we conclude that 



p 2 (t) = q 2 (t) = V 9l F(gi(t))gi(t) = V qi F( qi (t)) Pl (t) = 0, (43) 
and thus 



P2 (t) = V„G(i(t)) = 0. 



(44) 



Proceeding by induction along the chain it is easy to see that if G(x(t)) is 
constant on the interval [Ti,T2], then one has 



VG(x(t)) = 0. 



(45) 



and therefore x(t) G A. This concludes the proof of Lemma 2.2. 



2.3 Continuity properties of (x, y) 

In the analysis of the asymptotic behavior of the invariant measure it will 
be important to establish certain continuity properties of the cost function 
YjP (x,y). We prove first a global property: we show that for any time 
T, VjP\x,y) as a map from X x X — > R is everywhere finite and upper 

semicontinuous. Furthermore we need a local property of \x,y) near 
the cj-limit set of the zero-temperature dynamics (see Lemma |2.2| ). We 
prove that if x and y are sufficiently close to this w-limit set then Vy (x, y) 
is small. Both results are obtained using control theory and hypoellipticity. 

(v) 

Proposition 2.3 Assume condition K2. Then the functions Vj* , for all 
T > and V^' are upper semicontinuous maps : X x X — > R. 

Proof: By definition V^ v \y,z) is given by 

V^(y,z) = infI| T J2 \Mt)\ 2 dt, (46) 

where the infimum in ( |46] ) is taken over all u = (ui,u n ) G L 2 ([0, T]) such 
that 

9 = V P G, 
p = -V q G, 

r = - 7 A 2 V r G + (2 7 A 2 J D) 1 / 2 n, (47) 
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with boundary conditions 

(p(0), g(0), r(0)) = y , (p(T),q(T),r(T)) = z . (48) 



In other words, the infimum in ( |46| ) is taken over all controls u which steer 
y to z. For notational simplicity we let r% = qo and r n = q n +i- Furthermore 
we set Q = (q , q x ,...q n , q n +x) € R d ( n +V and P = (qx, . . . , q n ) € R*\ The 
equations ( |47|) take the form 

q = - 1 \ 2 V qo G{q Q ,q l ) + (2 1 \ 2 {l + r 1 )) 1 / 2 u l , 
q\ = -^q j G(qi- 1 ,q u qi +1 ) l = l,...,n, 
q n +i = -7A 2 V ?n+1 G(g n , (?n+1 ) + (27A 2 (l-7 ? )) 1 /2 Un) (49) 

with boundary conditions 

(P(0),Q(0)) = y, (P(T),Q(T)) = z. (50) 

By condition K2, V q ll^(q) is a diffeomorphism. As a consequence the 
identity 

<ll = -V qi G(qi-i,qi,qi+i) (51) 

can be solved for either qi_i or tft+i,: there are smooth functions and iif/ 
such that 

qi-l = Gi{qi,qi,qi+i) , (52) 

qi +1 = Hi(qi-.!,qi,qi}. (53) 

Using this we rewrite now the equations in the following form: We assume 
for simplicity re is an even number and we set j = re/2. (If re is odd, take 
j = (re + l)/2 and up to minor modifications the argument goes as in the 
even case). 

We rewrite Eq. (f49|) as follows: For the first j + 1 equations we use 
Eq. (g) and find 

ui = (2 7 A2(1 + r?))V2 ^° + ^ 2v go G (go> gi)) = C (go,go,gi) , 
% = G/+i(g/ + i,%+i,g/+ 2 ) Z = 0,l,...,j'-1. (54) 



For the remaining re + 1 — j = j + 1 equations we use Eq. (^) and obtain 
the equivalent equations 

1 



" n ~ (2 7 A 2 (1 - r,)jV2 + 7A V ^+i G ^n, ?n+l)) 

= H n+ i(q n ,q n+ i,q n+ i) , 
qi = Hi-x(qi- 2 ,qi-i,qi-i) I = j + 2,...,re + l. (55) 
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Obviously both sets of equations ( p4[ ) and ( pq ) can be solved iteratively to 
express u±,qo, . . . , qj-\ and qj+2, ■ ■ ■ > Qn+i, u n as functions of only qj, qj + \ 
and a certain number of their derivatives. We note q^ = [q, q^ 1 ', ■ ■ ■ ,q^) 
where q^ = d k q/dt k . From Eq. (54) we obtain, for some smooth functions 
Jo , • • • Ij, the set of equations 



u-i 



Qk = InUf*- k \$&- 1 - k)] ) , fc = 0,l,...,j-l. (57) 



Similarly from Eq. (55), we find smooth functions Jo, . . . Jj such that 

9k = Jn + 2^{ q f k -^ 2 \ q fi\-^) k = j + 2...,n+l. (58) 



u, 



Jo(^- 1] ,^ 1] )- (59) 



So far we have simply rewritten the differential equations of motion in an im- 
plicit form. From this we can draw the following conclusions. If (P(t), Q(t)) 



is a solution of Eq. (49) with given control u = (ui,u n ), then, using Eqs. ( |56| ) 
and (|5^) u can be written as follows: there is a smooth function B such that 

u{t) = B(qf +l \tufi + l l \t)), (60) 

i.e., u can be expressed as a function of the functions qj, qj+i and their 
first 2j + 1 derivatives. Furthermore if (P(t), Q{t)) is a solution of Eq. (|49|), 
from Eqs. (^) and (]58|), we can express (P, Q) as a function of qj, qj + \ and 
their first 2j derivatives. In particular this defines a map 
R 2d(n+l) ) where (p( t ),Q(t)) = jv (g} 2i+1] ,g^i +1] ) is given by 

9k = I»i{^- h \q?&- 1 - h)] ) > * = 0,1,...,J-1, 

% = % , k = j,j + 1, 

Qk = Qk, k = j, j + l, 

T ( [2(fc-j-2)l [2(fc-j-l)]\ , . . n . . 

ft = >9j-+i J, fc=j + 2...,n + l, 

. J / p(fc-j-2)+l] [2(k-j-l)+l]\ h _-, n , M \ 

Qk — Jn+2-k [Qj >9j'+l J' fe — J+2...,n. (OlJ 

We now show that N is a homeomorphism, by constructing explicitly its 
inverse. We use the equations of motion (49) to derive equations for q^ 
and qj+i- Differentiating repeatedly the equations with respect to time one 
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inductively finds functions smooth functions Kq, . . . Kij and Lq, . . . L<ij such 
that 

qf = K k ( q V\£\...4±Ur ] 4 + ~l 2] )> k = 0,...,2j, (62) 
«!5x = L k {^\^?4\ 2 ,...^\^), k = 0,1,..., 2j .(63) 

Eqs. (p2n and (62) define inductively a smooth map M from R M (" +1 ) to 

(sfUgl) = M(P,Q). (64) 



We have shown that if (P(t), Q(t)) is a solution of Eq. p9|), then 

(qf j] (t),qfi\(t))=M(P(t)Mt))- (65) 



Since the solution of (|49| ) is unique this shows that M is the inverse of 
the map N given by Eq. (|6l|) and thus N is a homeomorphism (in fact a 
diffeomorphism) . 

We have proven the following: The system of equations (49) with bound- 
ary data (50) is equivalent to equation ([k]) with the boundary data 

(qf j] (0),qf&(0)) = M(y), (qf j] (T), q%\(T)) = M(z) . (66) 

From this the assertion of the theorem follows easily: First we see that 
VjP\y, z) < oo, for all T > and for all y, z. Indeed choose any sufficiently 
smooth curves qj(t) and qj + i(t) which satisfies the boundary conditions 
( |66|) and consider the u given by Eq. (|60|). Then the function (P(t), Q(t)) = 
M (qf 3 \t),qf+i(t)) is a solution of Eq. @ with boundary data @ and 
with a control u(t) given by (|60|) which steers y to z. 

In order to prove the upper semicontinuity of VjP (y, z), let us choose 

(v) 

some e > 0. By definition of Vj> there is a control u which steers y to z 
along a path <p = <j) u such that 

I y ,T(<t> U ) < V^\y,z)+e/2, (67) 

and 

u{t)=B{qf + \t),qf£\t)), (68) 
Using the smoothness of B, we choose curves qj and qj+\ such that 

qnn \a [2j+l] n [2j+l] \ + \n [2j+1] n [2j+1] I < A CfiQl 

SU P 19, — 9 7 - I + |9 7 -+i — Q'-z+i |So, (pyj 
te[o,T] 
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and 5 is so small that 

u(t) = B(qf i+1 Kqfit 1] ), (70) 

satisfies 



sup \u{t)-u{t)\ < J-. (71) 
te[o,T] V l 

We note y = M(qf j] (0), gj+i( )) and z = N (qf j] (T) , qfH(T)) and 0" the 
path along which the control u steers the system, one obtains 

\Iy,T(r) ~ Iy, T m\ < \ - (72) 

By the continuity of the map N, we can choose 5' so small that if \y — y \ + 
\z — z\ < 5', then 

\qfHo)-qf J] m + i^ 2 4(o) -#4(o)i 

+ \qf j \T) ~ qf j] (T)\ + \qfA(T) - qfl\(T)\ <S. 
Therefore for all such y, z we have 

V™(y,z) < Iy, T (<f> n ) < V^(y,z)+e. (73) 

This shows the upper semicontinuity of VjP\y,z) and the upper semicon- 
tinuity of V^(y,z) follows easily from this. This concludes the proof of 
Lemma |2.3l I 



An immediate consequence of this Lemma is a bound on the cost function 
around critical points of the generalized Hamiltonian G. 

Corollary 2.4 For any x G A = {y : VG{y) = 0} and any h > there is 
5 > such that, if \y — x\ + \z — x\ < 5, then one has 

V^(y,z) < h. (74) 

Proof: If x £ A, x is a stationary point of the equation 

q = V P G, 
V = -V q G, 

r = - 7 A 2 V r G. (75) 

As a consequence the control u = steers to and hence V^\x, x) = 0. 
The upper semicontinuity of V^\y,z) immediately implies the statement 
of the corollary. | 
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Remark 2.5 This corollary slightly falls short of what is needed to obtain 
the asymptotics of the invariant measure. More detailed information about 
the geometry of the control paths around the stationary points is needed 
and will be proved in the next subsection. 



2.4 Geometry of the paths around the stationary points 

Let us consider a control system of the form 

m 

± = Y(x) +J2 x i(.x)ui (76) 
i=l 

where x £ R n , Y{x),Xi{x) are smooth vector fields. We assume that 
Y(x),Xi(x) are such that Eq. ([76]) has a unique solution for all time t > 0. 
We want to investigate properties of the set which can be reached from 
a given point by allowing only controls with bounded size. The class of 
controls u we consider is given by 

IAm = {u piecewise smooth, with \ut(t)\ < M , 1 < i < m} . (77) 

We denote Y<^(x) the set of points which can be reached from x in time less 
than r with a control u £ Um- We say that the control system is small-time 
locally controllable (STLC) at x if Yj^.(x) contains a neighborhood of x for 
every r > 0. 

The following result is standard in control theory, see e.g. [23] or |n| for 
a proof. 



Proposition 2.6 Consider the control system Eq. (76) with u S Um- Let 
xq be an equilibrium point ofY(x), i.e., Y(xq) = 0. If the linear span of the 
brackets 

ad k (Y)(Xi)(x) i = l,...,m, k = 0,1,2,..., (78) 



has rank n at xq then Eq. ( \76\ ) is STLC at xq. 

Proof: One proves Lemma |2.6| by linearizing around Xq and using e.g. the 



implicit function theorem, see e.g. [19], Chapter 6, Theorem 1. 



As a consequence of Lemma 2.6 and results obtained in || one gets 

Lemma 2.7 Consider the control system given by Eqs. with u E Um- 
Let xq be a critical point of G{x). If condition K2 is satisfied, then the 
system fiffl ) is STLC at xq. 
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Proof: The property of small time local controllability is expressed as a con- 
dition that certain brackets generate the whole tangent space at some point 
xq. This property is obviously related to the hypoellipticity of the generator 
of the Markov process (|5|) associated to the control system (|47|). The gen- 
erator of the Markov process which solves dy(t) = Y(x) + J2i Xi{x)dwi (t), 
where Wi(t) is a 1-dimensional process is given on sufficiently smooth func- 
tions by the differential operator L = (1/2) £»(V . • V) + Y ■ V. If 
Y(x) and X,i(x) are C°°, then L is hypoelliptic if the Lie algebra generated 



by Y(X) and Xi{x) generates the tangent space at each point x |12|. For the 
system of equations (|||), it is proved in ||, that if condition K2 is satisfied, 
then the brackets 



a d k (Y)(Xi)(x) i = l, 



k = 0,1,2, 



(79) 



generates the tangent space at each point x, in particular at every critical 
point xq, and therefore by Lemma 2.6 , the control system Eq. (^?j) is STLC 
at xo- I 

With these results we can derive the basic fact on the geometry of the 
control paths around equilibrium points of G(x). 

Proposition 2.8 Consider the control system given by fflj). Let xq be a 

critical point of G{x) and B(p) the ball of radius p centered at X$. Then for 
any h > 0, there are p' > and p > with p < p'/3 such that the following 
hold: For any x, y G B(p), there is T > and u G Um with 



r(0)=x ( f> U (T)=y, 
b u (t) E B(2p'/3) , te[0,T] 



(80) 
(81) 



and 



Proof: Together with the control system 
system 



I x ,t(4> u ) < h. (82) 
, we consider the time-reversed 



Q 
P 
r 



-V P G, 

- / X 2 V r G+(2-fX 2 D) 1 / 2 



u . 



(83) 



Lemma p7 implies the STLC of the control system (|47|). Furthermore from 
Lemma ^6 it is easy to see the control system (|83| ) is STLC if and only if the 
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control system (p7|) is. We note (f> u (4> u ) the solution of Eq. ( f47| ) (Eq. ( |83|) ) 
and Yrp 1 (x) {Yj? 1 (x)) the set of reachable points for the control system (|47| ) 
((83)). Using the convexity of the set of values the control can assume and 
the continuous dependence of 4> u on u, it is easy to see (p3|, Prop. 2.3.1) 
that Yrp f (x) is a compact set. 

We choose now M and T such that M 2 T < h. Since Y^(x) and Y^(x) 
are compact, there is p' > such that 

Y^(x),Y^(x)cB(2p'/3). (84) 

Furthermore we may choose p' arbitrarily small by choosing M and/or T 
sufficiently small. By Lemma |2~77| , both systems ( |4"7j ) and (83) are STLC and 
thus there is p > with p < p' /3 and 

B(p)cY^(x),Y T M (x). (85) 

Therefore there are controls u±,U2 € Um such that 

^(0) = x , fi(T)=y, (86) 

^ 2 (0) = x , ^ 2 (T)=x. (87) 

By reversing the time, the trajectory 4> U2 {t) yields a trajectory <p U2 (t) with 
0" 2 (O) = £ and <p U2 (T) = xq. Concatenating the trajectories 4> U2 {t) and 
(j) ui (t) yields a path </> from x to y which does not leave the ball B(2p'/3) 
and for which we have the estimate 

1 r 2T 

IxM<t>) = n dt\u(t)\ 2 < M 2 T < h , 

2 Jo 

and this concludes the proof of Corollary |2.8j. | 



3 Asymptotics of the invariant measure 

In this section we prove an extension of Freidlin-Wentzell theory [|| for a 
certain class of diffusion processes with hypoelliptic generators concerning 
the invariant measure. Such extensions, for the problem of the exit from a 
domain, exist, see J2j, where a strong hypoellipticity condition is assumed 
which is not satisfied in our model and see also ||] , where their assumption of 
small-time local controllability on the boundary of the domain is too strong 
for our purposes. Once the control theory estimates have been established, 
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our proof follows rather closely the proof of Freidlin-Wentzell j|] and the 
presentation of it given in || with a number of technical modifications. 
We consider a stochastic differential equation of the form 

dx £ = Y(x e ) + e 1/2 a{x £ )dw , (89) 

where i£l = R n , Y (x) is a C°° vector field, cr(x) a C°° map from R m to R n 
and w(t) a standard m-dimensional Wiener process. We view the stochastic 



process given by Eq. (8£) as a small perturbation of the dynamical system 

x = Y(x) . (90) 



We denote I x ,t{') the large deviation functional associated to Eq. ( p9| ) (see 



Eq. (|24f) ) and denote Vr(x,y) and V(x,y) the cost functions given by (|27| ) 
and (|28|). As in (8| we introduce an equivalence relation ~ on X defined as 
follows: x ~ y if V(x, y) = V(y, x) = 0. 

Our assumptions on the diffusion process x £ (t) are the following 

• LO The process x e {t) has an invariant measure \x £ . 

• LI There is a finite number of compact sets K\, K2, ■ ■ ■ Kl such that 

1. For any two points x, y belonging to the same Ki we have x ~ y. 

2. If x G Ki , y G Kj, with i 7^ j, then x ^ y. 

3. Every w-limit set of the dynamical system ( |90| ) is contained in 

We let -B(/o) denote the p neighborhood of Uj-fQ and r p the first time 
the diffusion x £ (t) hits the set B(p). We assume that for any £0 > 
the expected hitting time E x (t p ) of the diffusion with initial condition 
x is bounded uniformly for < e < £o- 

• L2 The diffusion process x £ (t) has an hypoelliptic generator. More- 
over, for any x G Ki the control system associated to Eq. (^) is 
small-time locally controllable. 

• L3 The diffusion process is strongly completely controllable, i.e., for all 

T > 0, Vr(x,y) < 00 and, moreover, Vr{x,y) is upper semicontinuous 
as a map from X x X to R. 
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Remark 3.1 For the model we consider, condition which ensures that LO 
holds are given in || ||. For condition LI we assume that the set of critical 
points of G(p,q,r) is a compact set and item (iii) follows from Lemma 2.2. 
The bound on the expected hitting time will be proved in a separate pub- 
lication pi] ]. For condition L2, the hypoellipticity of the generator and the 
small-time local controllability follows from K2, see Lemmas 2J3, 2/7 and 



2.8. Condition L3 is a consequence of condition K2, see Proposition \L[ 



Remark 3.2 Condition L2 is a local property of the dynamics and as such 
sufficient conditions can be given in terms of adequate Lie algebra. A simple 
sufficient condition for small-time local controllability was quoted and used 



in Section 2A. More general sufficient conditions have been proved, see [ P3j ] 
and references therein, condition L3 is a global condition on the dynamics 
and we are not aware of any general condition which would imply L3 (except 
of course ellipticity of the generator). 

To describe the asymptotic behavior of the invariant measure [i e we will 
need the following quantities. We let 

ViKuKj) = M V(y,z), i,j = l,...,L, (91) 

yehi,z£Kj 

V(Ki,z) = mf V(y,z), i = l,...,L. (92) 

We set 

W{K i )= min V V(K m ,K n ), (93) 
where the set of {i}-graphs G{i} is defined in the paragraph above Theorem 



1.4. The asymptotics of the invariant measure is given by the function W(x) 



given by 

W(x) = mm{W{Ki) + V{Ki,x)) -mmW(Kj) . (94) 

i 3 

We call a domain D C X regular, if the boundary of D, dD is a piecewise 
smooth manifold. Our main result is the following: 

Theorem 3.3 Assume conditions L0-L3. Let D be a regular domain with 
compact closure such that dist(L>, Uj-ftTj) > 0. Then the (unique) invariant 
measure [i e of the process x £ (t) satisfies 

limeln fiJD) = - inf W(z) . (95) 
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In particular if there is a single critical set K one has 



limeln// £ (D) = - inf V(K,z). (96) 

We first recall some general results on hypoelliptic diffusions obtained in 
[15 1, in particular a very useful representation of the invariant measure fi e 



in terms of embedded Markov chains, see Proposition 3.4 below. Then we 
prove the large deviations estimates. Let U and V be open subset of X with 
compact closure with U C V. Below, U and V will be the disjoint union of 
small neighborhoods of the sets K{. We introduce an increasing sequence of 
Markov times To, ctq, t\, . . . defined as follows. We set t = and 

a n = M{t > r n : x e {t) G dV} (97) 
r n = wf{t > a n _i : x £ (t) G dU} (98) 

As a consequence of hypoellipticity and the strong complete controllability 
of the control problem associated to the diffusion x e (t) (condition L2 and 
L3) we have the following result proven in [15] which extends to diffusions 
with hypoelliptic generators the characterization of invariant measures in 
terms of recurrence properties of the process x £ (t) and which is standard for 
diffusions with elliptic generators. 

We recall that the diffusion x e (t) is positive recurrent if 

1. It is recurrent, i.e., for all x 6 X for all open set Pel one has 

P £ x (Uu) = 1 (99) 
where TZjj is the event given by 

IZu = {x £ (t n ) £ U for an increasing sequence t n — > oo} . (100) 

2. For all x G X and for all open sets U C X, one has 

E £ x (au) < oo (101) 
where o\j = inf{t,x e (t) G U}. 



It is proven in |15|| , Theorem 4.1, that if the diffusion x £ (t) is hypoelliptic 
and strongly completely controllable then the diffusion admits a (unique) 
invariant measure \i e if and only if x £ (t) is positive recurrent. Clearly it 
follows from this result that, almost surely, the Markov times r,- and (re- 
defined in Eqs. (|97| ) and (^) are finite. 
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An important ingredient in the proof of the results in ]15| is the following 
representation of the invariant measure fj, e : Suppose x £ (0) = x G dU. Then 
{x e (rj)} is a Markov chain with a (compact) state space given by dU and 
which admits an invariant measure l £ {dx). The following result relates the 
measure l £ to the invariant measure fx £ , see e.g. [11], Chap. IV, Lemma 4.2. 
for a proof. 

Proposition 3.4 Let the measure v e be defined as 

u £ (D) = f l £ (dx)E £ x r l D (x £ (t))dt , (102) 
JdU JO 

where D is a Borel set and Id is the characteristic function of the set D. 
Then one has 

v e( X ) 

Up to the normalization, the invariant measure \x e assigns to a set D a mea- 
sure equals to the time spent by the process in D between two consecutive 
hits on dU . 



The proof of Theorem 3.3 is quite long and will be split into a sequence 
of Lemmas. The proof is based on the following ideas: As e — > the in- 
variant measure is more and more concentrated on a small neighborhood 
of the critical set Uji£j. To estimate the measure of a set D one uses the 



representation of the invariant measure given in Proposition 3.4 where the 
sets U and V are neighborhoods of the sets {Ki}. Let p > and de- 
note B(i,p) the ^-neighborhood of Ki and B{p) = UiB(i,p). Let D be 
a regular open set such that dist(UiiQ, D) > 0. We choose p' so small 
that dist(B(i,p'),B(j,p')) > 0, for i ^ j and dist(B(i, pi), D) > 0, for 
i = 1, . . . , L, and we choose p > such that < p < p 1 . We set U = B(p) 
and V = B(p'). We let oq and t\ be the Markov times defined in Eqs. (|97|) 
and (|98|) and let td be the Markov time defined as follows: 



t d = mf{t : x £ (t) G D}. (104) 
The first two Lemmas will yield an upper bound on u E (D), the unnor- 



malized measure given by Eq. (102). The first Lemma shows that, for e 
sufficiently small, the probability that the diffusion wanders around without 
hitting B(p) or D is negligible. 

Lemma 3.5 For any compact set K one has 

lim limsupelog sup P^(min{r£) A Ti} > T) = — oo (105) 

T^oo e ^o x&K 
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Proof: If x 6 D(JB(p), Tp Ari = and there is nothing to prove. Otherwise 
consider the closed sets 



F T = {<f> G C([0,T]) : <j)(8) iD\J B(p), for all s G [0,T]} . (106) 



Clearly the event {r > T} is contained in {x £ € -Ft}- By Theorem |2.1| , we 
have for all T < oo, 

limsupelog sup P^(x e G Ft) < — inf inf I x t{4>)- (107) 

e^O xGit x&K <j>&F T 

In order to complete the proof of the Lemma it is enough to show that 

lim inf inf I xT (4>) = oo . (108) 



Let (j) x be the trajectory of ( p0[ ) starting at x € i^. By condition LI, a ' 
hits B(p/3) in a finite time i 1 . By the continuous dependence of 4> x on its 
initial condition, there is an open set W x such that for all y G W x , <j) y hits 
the set B(2p/3) before t x . Since K is compact, there is T such that, for all 
x G K, (j) x hits B(2p/3) before T. Assume now that the identity ( 108 ) does 
not hold. Then, for some M < oo, and every integer n, there is if) n G F u t 
such that I n T(ipn) < M. Consequently, for some if) n k G Ft, we have 

M > I n T{^n) = y^-Wn.k) ^ n min • (109) 

Therefore there is a sequence 4> n G Ft such that lim n ^ 00 Ixi^n) = 0. Since 
the set {0 : I x ^T{<fi) < 1,0(0) € A"} is compact, n has a limit point 
(j) G -Ft- Since It is lower semicontinuous, we have ir(0) = and therefore 
is trajectory of (|90|). Since € Ft, remains outside of B(2p/3) and 
this is a contradiction with the definition of T. This concludes the proof of 
Lemma B.5L ■ 



Instead of the quantities V(K{,Kj) and V(K{,z) defined in Eqs. (|9l] 
and (p2|), it is useful to introduce the following quantities: 



V(Ki,Kj) = mf inf {I x , T (ct>), 0(0) G K h 0(T) G i^, 0(i) U^-tf,} , 
H^z) = inf inf {I x , T (<f>), 0(0) G Ki,<f>(T) = x,0(i) U,^,} (110) 

The following Lemma will yield an upper bound on the on v e (D), where 
v e is the (unnormalized) measure given by Eq. (|102|). 
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Lemma 3.6 Given h > 0, for < p < p' sufficiently small one has 

(i) limsupelog sup P £ (t d < n) < -( inf V(K U z) - h) , (111) 

e^O y£dB(i,p>) zeD 

(ii) limsupelog sup P^(x £ (ti) G dB(j,p)) < —(V(Ki,Kj) — h) . 



s^O y<=dB(i,p') 



(112) 



Proof: We first prove item (i). If inf^ e £> V{Ki, z) = +oo there is no curve 
connecting Ki to z G -D without touching the other Kj, j ^ i.. Therefore 
Py(rrj < T\) = and there is nothing to prove. Otherwise, for /i > we set 
\4 = infzgD V(Ki, z) — h. Since V(y, z) satisfies the triangle inequality, we 
have, by condition L2, that, for p small enough 

inf MV(y,z)> inf inf V(Ki, z) — sup V(K h y)>V h . 

yedB(i, P ') zeD y edB(i, P ') zeD y edB(i,p>) 

(113) 

where 

V(y,z) = mf inf {I x , T {<f>), 0(0) = y,0(T) = *,0(f) U^} . (114) 



By Lemma |3.5| , there is T < oo such that 

limsupelog sup P £ {rr> A ri > T) < -V/j . (115) 

e^O yedB(i,p') 

Let Gt denote the subset of C([0,T]) which consists of functions <f>{t) such 
that <f)(t) G D for some t G [0, T] and <f>(t) if i < inf{s , 4>(s) £ D}. 
The set Gt is closed as is seen by considering its complement. 
We have 

inf inf I vT (<t>) > mf m£V(y,z) > V h , (116) 
yedB(i, P >) 4>eG T y ' y&dB(i,p') ze o 



and thus by Theorem |2.1| , we have 

limsupelog sup Py(x £ G Gt) < — inf inf I y ^T(4>) < — . 

£^0 y edB(i,p>) y£dB(i,p') 4>&G T 

(117) 

We have the inequality 

Py(r D < n) < ^ £ (td A n > T) + P y e (x £ G G r ) , (118) 
and combining the estimates ( |115[) and (|117| ) yields 

limsupelog sup P«(t£>Ati) < — T4 . (H9) 

£-*0 y£dB(i,p') 
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This completes the proof of item (i) of Lemma 3.6. 

The proof of part (ii) of the Lemma is very similar to the first part and 
follows closely the corresponding estimates in M, Chapter 6, Lemma 2.1. 
The details are left to the reader. ■ 

The following Lemma will yield a lower bound on v e (D). It makes full 



use of the information contained in Lemmas 2.3 and 2. 



Lemma 3.7 Given h > 0, for < p' < p sufficiently small one has 

(i) liminfelog inf Pi (t d < n) > -(inf V(K h z) + h) . (120) 

£^0 x£dB(i,p) z£D 

(ii) liminfelog inf i*(s e (n) G dB{j,p)) > -(V(Ki,Kj) + h) . 

e^O x£dB(i.p) 

(121) 

Proof: We start with the proof of item (i). If ini z& r) V(Ki, z) = +oo there 
is nothing to prove. Otherwise let h > be given. By condition L2, (see 
Corollary |2.8| ), there are p and p' > with p < p' /3 and To < oo such that, 
for all x G dB(i, p), there is a path ip x G C([0, To]) which satisfies Ix^oi^) < 
h/3 with ^(0) = x and rp x (T ) = x G K { and ip x (t) G B(2p'/3), <t< T . 

By condition L3, there are z G D, T\ < oo and 4>\ G C([0, TJ) such that 
4 ,Ti(^i) < mf ze Dy(ifj,z) + /i/3 and </>i(0) = x G i£j and 4>i(Ti) = z and 
01 does not touch with j ^ i. We may and will assume that p and p' are 
chosen such that 2p' < dist(^i(i), U^iT.,-. We note A = dist(z, <9D). Let 
x\ be the point of last intersection of 4>\ with dB(i,p) and let t\ such that 
<j>i (ti) = x\. We note <f>2 G C([0,T2]), with = T\ — t±, the path obtained 
from <pi by deleting up to time ti and translating in time. Notice that the 
path (f>2 may hit several times dB(i,p'), but hits dB(i,p) only one time (at 
time 0). Denote as 

a = inf {t : <f> 2 (t) G dB(i, p')} (122) 



the first time ^(t) hits dB(i, p'). We choose A' so small that if ip G C([0, T2]) 
belongs to the A'-neighborhood of $2, then ijj(t) does not intersect dB(i, p)} 
and dB(i,p')} for < t < a and and does not intersect dB(i,p)} for t > a. 

By condition L2, there are T3 < 00 and ^3 G C([0, T3]) such that ^3(0) = 
x , MT3) = a?i, Mt) G 5(2/573), < t < T 3 , and 4 o ,t 3 (03) < h/3. 
Concatenating ?p x , ^3 and </>2, we obtain a path <p x G C([0, T]) with T = 
To + T3 + T2 and I x ^t{4> x ) < inf^gD V(Ki,z) + /i. By construction the path 
(f> x avoids dB(i, p)} after the time Tq + T3 + a where a defined in Eq. ( |122|) . 
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We consider the open set 



U T 



u 

xddB{p) 



</>eC([0,T]) : 



rP A A' 

< mml — , — , — 
l 3 2 2 



>}■ 



(123) 



By construction the event {x e {t) G Ut} is contained in the event {td < Ti}. 
By Theorem 2.1 we have 



lim inf £ log inf (r D < n ) 

e^O x€dB(p) 



> lim inf e log inf Pt(x e G JTr) 

£^0 x£dB(p) 

> - sup inf I x>T (ip) 

xedB(p) 

> - sup I x ,t(4> x ) 

xGdB(p) 

> -(MV(Ki,z) + h). 



(124) 



This concludes the proof of item (i). 

The proof of (ii) follows very closely the corresponding estimate in |||, 
Chapter 6, Lemma 2.1., which considers the case where the generator of the 
diffusion is elliptic: for any h > one construct paths <jf y G C([0,T]) from 
x G 8B(i,p) toy £ 8B(j,p) such that I x ,T(<t> xy ) < V(Ki,Kj) + h/2 and such 
that if x £ (t) is in a small neighborhood of (j) xy , then x £ {t\) G dB(j,p). As 
in part (i) of the Lemma, the key element to construct the paths <j) xy is the 
condition L2 of small-time controllability around the sets K^. The details 
are left to the reader. 

This concludes the proof of lemma 3/? . ■ 

The following two Lemmas give upper and lower bounds on the normal- 
ization constant u £ (X), where v £ is defined in Eq. fll02|) . 

Lemma 3.8 For any h > 0, we have 



lim inf elogv £ (X) > 

£— >0 



-h. (125) 
Proof: We choose an arbitrary h > 0. For any p' > we have the inequality: 



v e {X) > 



MB(p')) 

l £ {dx)E: 
9B(p) 



^B{p'){x £ {t))dt 



> 



/ l £ {dx)El / l B{pl) (x £ (t))dt 

JdB{p) JO 



8B(p) 



l £ (dx)E e x (a Q ) 
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We use a construction similar as that used in Lemma p.7\ Using condition 
L2, there are p and p' > with p < p'/3 such that such that for all x G 
dB(p), there are Ti < oo and ip x G C([0, T x ]) such that ^(0) = x, ij) x {T{) = 
x G UiKi, i) x (t) e 5(2/3/3), < t < Ti and I x ,tM x ) < V 4 - Furthermore, 
using Corollary |2.4| , for // small enough, there are z G dB(p'), T 2 < oo, and 
ij) G C([0,T 2 ]) such that ^(0) = x Q , ^(T 2 ) = z, ift(t) G S(p') for < t < T 2 , 
and I X0 ,T 2 (i>) < h/A. We denote (j? G C([0,T]), with T = T x + T 2 , the 
path obtained by concatenating ip x and '0. It satisfies I X) t{iP) < fr/2. We 
consider the open set 

Vt= (J UeC([0,T]) : ||V-^||<f}. (126) 



Applying Theorem 2.1, one obtains 



liminf elog inf P^(x £ G Vr) > - J • (127) 

e^O xGdB(p) 2 

There is T* > 0, such that for any eft G Vr the time spent in B{p r ) is at least 
T* . Therefore, for e small enough we obtain the bound 



/ l £ (dx)El(a ) > T* exp (- A) > e xp (--) , (128) 



and this completes the proof of Lemma 3.8 



To get an upper bound on the normalization constant v e (X) we will 
need an upper bound on the escape time out of the ball B(p') around UiKi, 
starting from x G dB{p). 

Lemma 3.9 Given h > 0, for < p < p' sufficiently small, 

limsupelog sup E^(ao) < h . (129) 

£->0 xGdB(p) 

Proof: Fix h > arbitrary. As in Lemma [T^, we see that, for < p < p' 
sufficiently small and for all x G dB(p), there are T%, T 2 < oo, z £ B(p') and 
<jf G C([0,7i+T 2 ]) such that </> x (0) = x, (jf{T x ) G U^, and<^(Ti+T 2 ) = z, 
and /x.Ti+TaC^*) < V 2 - We set T = Ti + T 2 and A = distfo -B(p')) and 
consider the open set 

w To = (J |^ec([o,r ]) : ||v-^||<fl, (130) 



29 



so that if tp £ Wt it escapes from B(p') in a time less than To, i.e., the 
event{x e £ Wr } is contained in the event {<7o < To} . Using Theorem 2A, 
we see that for sufficiently small e, one has the bound 

/; 



inf P £ (a <T ) > exp 

x£dB(p) 



2e 



(131) 



Consider the events do > ATo, k 
obtains the bound 



1,2,.... Using the Markov property one 



P £ (a > (k + l)T 



< 
< 



[1 - P £ (kT <a <(k + 1)T )] P|(a > kT 



(1 - q)P*(a > kT 



Iterating over k yields 



sup P £ (a > kT ) < (1 
xedB(p) 



(132) 



(133) 



Therefore 



sup E £ x (a ) < 
xedB(p) 

< 



To 



1 + sup P £ (a >kT ) 

k=l x£dB(p) 

OO rji 

,u io 



fc=0 



_(_o 



(134) 



(135) 



Since q > exp (— ^) one obtains, for sufficiently small e 

sup T^,(cr ) < T exp(^) < exp 

xedB(p) \£ 

This concludes the proof of Lemma ■ 

With this Lemma we have proved all large deviations estimates needed 
in the proof of Theorem We will need upper and lower estimates on 
l e (dB(i, p)) where l e is the invariant measure of the Markov chain x £ (rj). 
These estimates are proved in J8[, Chapter 6, Section 3 and 4 and are purely 
combinatorial and rely on the representation of the invariant measure of a 
Markov chain with a finite state space via graphs on the state space. By 
Lemma |3.6| , (ii) and 3.7, (ii) we have the following estimates on the prob- 
ability transition q(x,y), x,y £ dB(p) of the Markov chain x e (r 7 ): Given 
h > 0, for < p < p' sufficiently small 



e* V -- £ (V(K u K j )+h) < q(x,dB(j,p)) < exp —^-(V(Ki, Kj) - h) 



(136) 
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for all x £ dB(i,p) and sufficiently small e. It is shown in []|], Chapter 6, 
Lemmas 3.1 and 3.2 that the bound (|136| ) implies a bound on l £ (dB(i, p)). 
One obtains 

exp (-l(W(Ki) -mmW(Kj) + h)^j < l £ {dB{i,p)) < 

< exp (~(W(Ki) - mmW(Kj) - h)\ (137) 

for sufficiently small e, where 

W{Ki) = min V V(K m , K n ) . (138) 

g€G{i} , , 

Also in Chapter 6, Lemma 4.1, W{Kj) is shown to be in fact equal to 
W{Ki) defined in Eq. ©: 

VF(^) = min V V(K m ,K n ) 
g£G{i} , , 

= W^tfi). (139) 

Furthermore it is shown Lemma 4.2 there that the function W(x), defined 
by Eq. (B4j), satisfies the identity 

W(x) = mm(W(Ki) + V(Ki,x)) - m.mW(Kj) 

* 3 

= min^^) + V(Ki,x)) - min^) (140) 

* i 



We can turn to the proof of Theorem 3.3 . 
Proof of Theorem 3.5: 

In order to prove Eq. (9^), it is enough to show that, for any h > 0, 
there is £q > such that, for e < So we have the inequalities: 

p £ {D) > expf--(inf W(z)+h)\ , (141) 

p e (D) < exp (~^(™f W(z) -/»))■ ( 142 ) 

We let p' > such that // < dist(x m j n , D). Recall that td = inf{i : 
x £ (£) 6 D} is the first hitting time of the set D. we have the following 
bound on the v £ (D) 

Ve{D) < Y,le(dB(i,p)) SUp E% r l D { Xe {t))dt 
i x£dB{i,p) JO 

< Lmaxl £ (dB(i,p)) sup P^(t d < n) sup E e (n) . (143) 

1 x£dB(i,p) y&dD 
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By LI, there exist a constant C independent of e such that 

sup E e y ( n )<C, (144) 

y&dD 

for e < £q. From Lemma |3.6| , (i), given h > 0, for sufficiently small < p < 
p' , we have the bound 

P £ x {td < ti) < exp (--( inf V^, 2) - ^/4)) , (145) 



for sufficiently small e. From Eq. (|137| ), given h > 0, for sufficiently small 
< p < p 1 , we have the bound 

l e (dB(i,p)) < exp(--{W(Ki)-mmW(Kj)-h/4:)\ (146) 

From the estimates ( |143j )-( [i~46 ), and the identity (|140| ) we obtain the bound 

i/ e (Z>) < exp (--(mmW(z) + /i/2)^ , (147) 



for sufficiently small e. From Lemma 3.8, given h > 0, for sufficiently small 
< p < p' , we have the bound 

z, e (X) > exp (-^j , (148) 

for sufficiently small e. Combining estimates ( |147| ) and ( |148| ), we obtain 
that 

H E (D) < exp - fc)) , (149) 



for sufficiently small e and this gives the bound ( |142j ). 

In order to prove ( |141| ), we consider the set D$ = {x G D : dist(x, dD) > 
8}. For 5 sufficiently small, D$ 7^ 0. By L3, V(Ki,z) is upper semicontinu- 
ous in z so that V(K{, z') < V(K{, z) + h/4, for z' — z < 5. Therefore 

inf V(K h z) < inf V{K h z) + h/A . (150) 

We have the bound 

u e {D) > m a *l £ (dB(i,p)) inf M(t Ds < n) inf H l D (x £ (t))dt . 

1 x£dB(t,p) x£dD s Jo 

(151) 
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There is Eo > and a constant C > such that we have the bound 

inf E% f 1 l D (x £ {t))dt > C > 0, (152) 

x&D s Jo 

uniformly in e < Eq. From Eq. ( |137|) , given h > 0, for sufficiently small 
< p < p', we have the bound 

l E (dB(i,p)) > exp ^~(W(Ki) -mmW(Kj) + V 4 )) > (!53) 



for sufficiently small e. Furthermore, by Lemma 3.7 and inequality ([L5 1 
given /i > 0, for < p < p' sufficiently small, we have 

1 

x£dB{i, P ) * - -o — ~< - ^ \ e "zeD 



inf ^ P e x {r Ds < n ) > exp ( --(inf F(/Q, z) + h/4) ) , (154) 



for sufficiently small e. Combining estimates ( pL51[ ) ( p~5^ ) and identity ( |140| ) 
we find 

vJD) > exp ( — (inf W(z) + h/2)] . (155) 

\ e ze-D / 

In order to give an upper bound on the normalization constant v £ (X) } we 
use Eq. ( |102| ). Using the Markov property, we obtain 

u £ (X) = f l B (dx)E*( n ) 

l £ {dx) (E&ao) + E^E^in))) 

dB(p) v ' 

< sup E £ x (a )+ sup ££(n). (156) 

xddB{p) yedB(p') 

By Lemma |3.9| , given h > 0, for sufficiently small < p < p' we have the 
estimate 

sup E £ x (a ) < exp (—) , (157) 

xedB(p) 

for sufficiently small e. By LI, the second term on the right hand side of 
( |156j ) is bounded by a constant, uniformly in < e < eo- Therefore for we 
obtain the estimate 

v £ (X) < exp (A) , (158) 

for sufficiently small e. Combining estimates (155) and ( |158j ) we obtain the 
bound 

He{D) > exp [ --(inf W{z) + h)] , (159) 
and this is the bound ( |141| ) . This concludes the proof of Theorem |3.3| . ■ 
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4 Properties of the rate function 



In this section we prove assertions fllq ) and ([L7]) of Theorem |1.4| and Propo- 
sition 1.7. Recall that for Eq. (|5|), the rate function, (</>), takes the 
following form: For 4>{t) = (p(t), q(t),r(t)), 

= j\r + 1 \ 2 V T G)D-\r + 1 \ 2 V r G) (160) 

if 

q = V p G, p=-V q G, (161) 

and is +oo otherwise. Recall that for a path <p & C([0,T]) with 0(0) = x 
and (f>(T) = y we denote the time reversed path which satisfy (j)(0) = Jy 
and 4>{T) = Jx. 

Proof of Proposition \1 . % We rewrite the rate function as 

4%w = 

= — ^ / (r + 7 A 2 V r G)Z?- 1 (r + 7 A 2 V r G)(it 
4 7 V Jo 

= — ^ f T (r--fX 2 V r G)D- 1 (r-jX 2 V r G)dt+ C (V r G)D- l rdt 
4 7 A Z Jo Jo 

= K^) + K 2 {<P) (162) 

The term Ki((p) has the following interpretation: It is the rate function 
corresponding to the the set of stochastic differential equations 

dq = VpGdt , 
dp = -V q Gdt , 

dr = +-f\ 2 V r Gdt + e 1/2 (2-/X 2 D) 1 / 2 dw. (163) 

In particular there is u G L 2 ([0, T]) such that for <f>(t) = (p(t),q(t),r(t)), 
with (f)(0) = x and <j>(T) = y we have 

g = v p G , 

p = -V q G, 

r = + 7 A 2 V r G + (2 7 A 2 J D) 1 /V (164) 

Consider now the transformation (p, q, r) — > J(p, g, r) and t — > — t. This 
transformation maps the solution of Eq. fll64| ) into 0(i) = (p(t),q(t),r(t)) 
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which is the solution to 



q = V P G, 
P = -V,G, 

f = - 1 \ 2 V r G + {2 1 \ 2 D) l l 2 u{t), (165) 
with 4>(0) = Jy, 4>(T) = Jx. This implies the equality 

Kx{<t>) = i ^^ T (f- 7 A 2 V r G)£'- 1 (f-7A 2 V r G') 

= — ^- Ar + 1 \ 2 V r G)D~ l {? + 1 \ 2 V r G)dt 
4A Z 7 Jo 

= Ijt T (4>)- (166) 



This means that K\ (4>) is nothing but the weight of the time reversed path, 
i.e. the path starting at time from Jy and leading to Jx at time T. 

We now consider the second term K2(4>) in Eq. ( 162 ). We consider 
separately the equilibrium case (i.e., rj = 0) and the non-equilibrium case 
(i.e. rj 7^ 0). For rj = the matrix D is the identity and we find 

K 2 (<f>) = [ T V r Gfdt (167) 



Using the constraints q = V p G and p = —V q G we obtain the identity 
VpGp + V q Gq = and therefore we get 

( T V r Grdt = [ T (V r Gr + V p Gp + V q Gq)dt 
Jo Jo 

= [ jGdt = G(y)-G(x), (168) 



and this proves Eq. fl22|) in the case rj = 0. 

To prove Eq. (p2]) in the case rj ^ observe that we have the identity, 



^(\-\-\ qi f = ( A - 1 r i -Ag i )(A- 1 r i -A%) = W ri G(\~~ l fi - Xpi) , 

(169) 

for i = l,n, and therefore 

V n Gh = \ 2 Vrfi Pl + ^(A -1 r< - Ag 4 ) 2 • (170) 
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Hence, using the definition (21), we obtain 



K 2 {(f>) = f V r D- l Grdt = R(4>(T)) - R((f>(0)) - f G(<f>(t))dt (171) 
Jo J o 

This completes the proof of Proposition |0]. ■ 

With generalized detailed balance we show the following 
Proposition 4.1 If rj = then W^°'(x) = G(x) — min x G(x). 
Proof: The function W^°\x) is given by 

W (i) \x) = min ( W {0) (Ki) + V {0) (K u x)) - min W^(Kj) . (172) 



j 

where the minimum is taken over all compact sets In Eq. Q, W^(Ki) 
is given by 

W<®(K i )=mm V V^K m ,K n ). (173) 
geG{i} , ^-C 

The sets Kj are the critical sets of the generalized Hamiltonian G(p,q,r), 
therefore G is constant on Kj and we set G(x) = Gj for all x € Kj. Fur- 
thermore if (p, q, r) £ Kj, then p = and therefore the sets -fTj are invariant 
under time reversal: JKj = Kj. Using the generalized detailed balance, we 
see that for any path 4> £ C([0, T]) with 0(0) = x £ if m and 0(i) = y G 
we have 

= 45,t(^) + G (2/) - = + °n - G m . (174) 

Taking the infimum over all paths <f> and all time T, we obtain the identity 
V {0 \K m ,K n ) = V^(K n ,K m ) + G m -G n . (175) 
In Eq. (p.73|) the minimum is taken over all {z}-graphs (see the paragraph 



above Theorem IA in the introduction). Given an {z}-graph and a j with 
j i, there is a sequence of arrows leading from j to i. Consider now the 
graph obtained by reversing all the arrows leading from j to i; in this way 
we obtain a {j}-graph. Using the identity (175) the weight of this graph is 
equal to the weight of the original graph plus Gj — Gj. Taking the infimum 
over all graphs we obtain the identity 

W®{Ki) = W^(Kj) + Gj - G t , (176) 
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and therefore we have 

W^(Ki) = d + const, (177) 

and so 

— min Gj . (178) 

i i 

The second term in Eq. (|178[) is equal to min x . G(x), since G(x) is bounded 
below. 

We now derive upper and lower bounds on the first term in Eq. ( |178j ) . A 
lower bound follows easily from Proposition 1.7: For any path € C([0, T]) 
with (f)(0) = z € Ki and 4>(T) = x we obtain the inequality 

= JjStM + G ( x ) G ( x ) - °i > ( 179 ) 

since the rate function is nonnegative. Taking infimum over all paths <j> and 
time T we obtain 

iy (0) (x) > g(x) — min . (180) 

To prove the lower bound we consider the trajectory <j) starting at Jx at 
time which is the solution of the equation 

fa = V Pi G i = l,---,n, 

Pi = -V qi G i = l,...,n, (181) 
h = -j\ 2 V ri G i = l,n. 



By Lemma 2.2, there is some Kj such that lim^oo <p(t) G Kj. Fur- 
thermore, since </> is a solution of Eq. (181), the rate function of this path 

vanishes Ij^t^) = 0> f° r an y ^ > 0. Note that an infinite amount of time 
is needed to reach Kj in general. Now consider the time reversed path <f>(t). 
It starts at t = —T with T < oo at Ki and reaches x at time 0. For such a 
path we have 



r(0)^ _ r(0) 
and therefore 



lim (0) = lim 4 u j(0) + G(x) - d = G(x) - G t , (182) 



vW(K h x) < G{x)-Gi. (183) 

We finally obtain 

W {0 \x) < G l + V ( - 0) (K i ,x) -minG(x) < G(x)-mmG(x) (184) 
and this concludes the proof of Proposition | 
We have the following bound on the rate function: 



37 



Lemma 4.2 If rj > then for any <p G C([0,T]), 
and o similar bound for rj < 0. 

Proof: The proof follows from the fact that the subset of C([0, T]) on which 
< oo is independent of ??. This is seen from the definition of rate 



function (g4|). Inspection of Eq. (|160| ) implies the bound (185). 

From this we obtain immediately 

Corollary 4.3 If rj > then 

(l + ny^Gix) -minG(x)) < W(">(z) < (1 - rj)' 1 {G{x) — minG(x)) . 

(186) 

and a similar bound for rj < 0. 



This concludes the proof of Theorem 1.4 
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